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X11 — Video Rendering 


e Traditionally Xv extension used for rendering video 


— Xshm buffers: 2x memcpy 
e Not terribly good for hw decoders that have special memory requirements 


e And not terribly good for GPUs either.. need a copy into a GPU accessible buffer 
or at least map/unmap on every frame (userptr) 


e DRI2 


— Used under the hood by VAAPI/VDPAU.. but can only support unscaled 
RGB buffers, so GPU blit YUV->RGB + scaling done on client side 
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X11 — dri2video 


Example memory bandwidth savings based on 1080p 30fps NV12 video rendered to 


nearly fullscreen window on 1280x1024 display 


NV12->RGB = (1920*1080*1.5) + (1280"1024"4) — 239MiB/s 
Video Player 


Swap/blit = (1280"1024"4) * 2 — 300MiB/s 
Composite = (1280"1024"4) * 2 — 300MiB/s 
Presentation blit < (1280"1024"4) " 2 — 300MiB/s 


NV12->RGB = (1920*1080*1.5) + (1280"1024"4) — 239MiB/s 


Swap/blit = (1280"1024"4) * 2 — 300MiB/s 
Composite = (1280"1024"4) " 2 — 300MiB/s 
Presentation blit = (1280"1024"4) " 2 — 300MiB/s 


XI Window 
Manager 
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539MiB/s (no comp) 
1139MiB/s (comp) 


Video Player 


X11 


239MiB/s (no comp) 
839MiB/s (comp) 
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X11 — dri2video 


Combines the ideas of Xv and DRI2 


e Xserver (DDX driver) allocates GEM buffer and passes to client 
process 
— Allows to use VRAM or deal w/ any other special memory requirements 


But unlike DRI2, the buffer can be YUV (incl. Multi-planar), sized 
according to video size, not scaled drawable size, and cropped 


e Can support zero-copy overlays too if display can scanout GEM buffers 


e Should be helpful for other hw decoders: VAAPI, etc 


— Esp. UMA setups where the extra blit is consuming system memory 
bandwidth 
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Proto — New messages 


e DRI2GetBuffersVid 
— Like DRI2GetBuffersWithFormat but adds width/height 


e DRI2SwapBuffersVid 
— Like DRI2SwapBuffers but adds src crop coords 


e DRI2SetAttribute / DRI2GetAttribute 


— Analogous to Xv Get/SetPortAttribute 
e CSC matrix, etc 


e DRI2GetFormats 


— Get supported fourcc formats 
* Recommendation: use at least one "0' or non 7-bit ascii character for custom formats 


e DRIZBUFFER 
— Add extra name/pitch (for multi-planar formats) 
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Things missing 


e Interlaced / Stereo 
e Client process control over single buffer vs buffer per plane 


e Destination coordinates 
— Preserve aspect ratio independent of dest drawable dimensions? 


e Possible Idea 


— Make traditional dri2 and dri2video attachment points non-overlapping 
e Fallback to dri2 for anything dri2video can't do? 
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